Papers with average OOD robustness
Are Sample-Efficient NLP Models More Robust? (2023.acl-short)
Copied to clipboard
| Challenge: | Recent work in image classification and extractive question answering have observed that pre-trained models trained on less in-distribution data have better out-of-distortion performance. |
| Approach: | They conduct a large empirical study to investigate the relationship between sample efficiency and robustness. |
| Outcome: | The results show that pre-trained models with lower sample efficiency perform better on some tasks but not others. |